Slowly making the way through all of your contributions here @mrginglymus. This one is a little meatier, so I can't promise I get through it very quickly, but if you'll catch up to main, I'll do my best. 🙇🏼

Amazing, thanks @Westbrook! All up to date now. One outstanding bit of work on this is checking how 'skipped' appears on the output docs - we obviously don't have nay currently skipped tests.

Created a branch (#2513) to demonstrate a skipped test.

This shows effectively as a fail (or a 'not pass') on the front page:

and a skip on details:

Do we want to count skipped tests as fails on this headline (show 14/16) or do we want to not count them at all (show 14/14, 100%). The first option doesn't seem particularly fair, the second isn't particularly accurate....

There aren't currently skipped tests, right? Do you foresee expanded to skipped tests in the near future?

Skipped tests will happen when a new test is added that requires a new component. Until that component is implemented in each framework, it will show as skipped.

The benefit of this PR is that adding or modifying a test will immediately be reflected in all frameworks.

The downside is that adding a test that requires a new component requires that component to be implemented in each framework.

Making unimplemented components skip tests I felt was a reasonable compromise to allow us to continue to add new tests without being fully blocked by the tedium of having to implement every framework.

Obviously we should aim for complete coverage, but at least for local development having tests skip instead of fail will make the process smoother

I've just tried using this to add an aria-selected={false} test and...it's a right pain having to update all of the values. I don't think that skipped tests should be included in the score or in e.g.

  "basicSupport": {
    "total": 20,
    "failed": 4,
    "passed": 16
  },

otherwise one has to update all the files (which is tedious when considering scores) when adding a test.

See mrginglymus#1 for an example new + partially implemented test